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Abstract 

We introduce estimators for the entropy production of a Gibbsian pro¬ 
cess based on the observation of a single or two typical trajectories. These 
estimators are built with adequate hitting and return times. We then 
study their convergence and fluctuation properties. This provides statis¬ 
tical tests for the irreversibility of Gibbsian processes. 
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1 Introduction 


In the theory of non-equilibrium statistical mechanics, the entropy production is 
a crucial quantity. Typical for non-equilibrium steady states is the (strict) pos¬ 
itivity of the entropy production which is accompanied by presence of currents 
and hence breakage of time-reversal symmetry. In m the entropy production 
was introduced at the level of trajectories. The idea is that even for a non¬ 
equilibrium system in the steady state, the space-time measure is still a Gibbs 
measure and the asymmetric part under time reversal of the Hamiltonian of 
the space-time Gibbs measure is the entropy production. Hence, in this for¬ 
malism, the entropy production is a trajectory-valued function which measures 
the degree of irreversibility. The relative entropy density between the forward 
and the backward process is then the mean entropy production, which is strictly 
positive if and only if the process is reversible (i.e., in “detailed balance”, or 
“equilibrium”). See also m for the relation between strictly positive mean 
entropy production and reversibility, and [HI for a recent account on entropy 
production in a broader context. 

In this point of view, in order to estimate the entropy production, e.g., 
in order to test the reversibility of the process, one needs a way to compute 
it from trajectories. This is quite similar to the problem of estimating the 
entropy of a process. A basic approach consists in approximating the measure 
by its empirical version m- Another particularly useful and simple way of 
estimating entropy is via the Ornstein-Weiss theorem [iniEi]. The entropy is 
approximated by the logarithm of the return time of the first n symbols, divided 
by n. Similarly, relative entropy density can be estimated using waiting times, 
see e.g. m In this paper we consider Gibbsian processes with values in a finite 
alphabet, and with summable modulus of continuity. We introduce an estimator 
of the entropy production based on a single trajectory (we call it the hitting- 
time estimator) and an estimator based on two independent trajectories (which 
we call the waiting-time estimator). For both estimators we obtain consistency 
and asymptotic normality, with an asymptotic variance coinciding with that of 
the entropy production. Moreover, for the waiting-time estimator we obtain 
a large deviation principle. It turns out that its large deviation function has 
the same symmetry as in the so-called fluctuation theorem pea EH], and in 
fact coincides with the large deviation function of the entropy production itself 
in the region where it is finite. This shows that the estimator has also nice 
properties from the physical point of view. The basic technique we use is the 
exponential law with good control of the error for hitting and waiting times 
PE]. This provides us with a precise control of the difference between the 
estimators and the entropy production. 

The rest of the paper is organized as follows. In section 2 we introduce the 
entropy production in the spirit of m, see also Ej- In section 3 we introduce 
the estimators, in section 4 we state their fluctuation properties and section 5 
is devoted to proofs. 
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2 Context 


We will consider a stationary process {X^ : n G Z} taking values in a finite set 
A. A trajectory of this process, i.e., an element of will be denoted by uj. 
The space of all trajectories is denoted by 0 = For a; G and n G Z, O^u} 
is the trajectory defined by {9n0j)k '■= ^k+n- A function / : 0 ^ M is called 
local if it depends only on finitely many coordinates of the trajectory. A block 
of length n is a sequence x” := xi • • • of elements of A. The cylinder [x^] 
based on x” is the set of a; G n such that tOj = Xj for j = 1,..., n. 

The distribution P of the process {X„ : n G Z} is supposed to be a trans¬ 
lation invariant Gibbs measure with translation invariant potential U. The 
associated “energy per site” fu is defined as usual: 




E 

AsO 


U{A,io) 


where the sum runs over all finite subsets of Z (containing the origin). 

It is well-known that under mild assumptions [7j there exists a constant 
K > 0 such that for all x”, all to G [x”], we have the uniform estimate 


< 


P([x^]) 


exp(nP(/{/) -F fuiOj^^)) 


< K 


( 1 ) 


where P{fu) is the “pressure” associated to U. 

For a block x”, its time reverse is denoted by x^ = XnXn-i ■ ■ ■ xi. Similarly, 
denotes the random block Xi ■ ■ ■ X^ whereas denotes the random block 

Xn---Xi. 

For the definition of the entropy production of the process {A„ : n G Z}, we 
follow [T^ 115) . We denote by P^ the distribution of the time-reversed process, 
i.e., the distribution of {Ai_„ : n G Z}. The entropy production of the process 
up to time n is defined as 


S„(Xi,...,A„) :=log 


p([^r]) 


log^i™ . 
^P«([Af]) 


( 2 ) 


This random variable is a measure of the irreversibility of the process up to 
time n. 

We recall that the relative entropy density /i(Q|P) between a translation 
invariant probability measure Q on 0 and P is the limit 


/i(Q|P) = lim 

n—*oo 


Hn{Q\F) 

n 


where 


F„(Q|P):= Q([x?])log 


Q([^?]) 

P([xj^]) 


We have the following well-known properties [Jj: 


h{Q\F) = P{fu) 


fu dQ + s(Q) 
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where s(Q) is the entropy density of Q. Moreover, /i(Q|P) > 0, with equality if 
and only if Q is an equilibrium state for U (variational principle). 

Using o and the Ergodic Theorem, it follows immediately that 


lim ^—— = /i(P|P^) := MEP P — almost surely. (3) 

n—>oo Tl 

This quantity is called the mean entropy production. It is equal to 0 if and only 
if the process is reversible, i.e., the potential associated to P^ is physically 
equivalent to the potential U. 

We now precise the classes of potentials for which our results hold. 

A hrst restriction is to assume that fjj has a summable modulus of conti¬ 
nuity, i.e., 

var „/(7 < oo (4) 

n>l 

where 

varnfu ■= sup{|/; 7 (a;) - fu{<^')\ ■ = w',V|i| < n} . 

In particular this implies that P is the unique Gibbs measure (equilibrium state) 
with potential U. It is convenient to work with an fjj which depends only on 
“future” coordinates, that is, only on wi,a; 2 ,.... It is indeed proved in that 
if fu satisfies 0), then there exists a function /^{co) := ■ ■ ■) which 

is physically equivalent to fu, i.e., which gives the same Gibbs measure as fu, 
and which has also summable variations. “Physically equivalent” means there 
exists a measurable function k = ku and a real constant C = Cu such that 
fu — fu + —+ C. It is easy to check that (P) holds with f^ in place of fu 
by suitably modifying the constant K. Moreover, we can simplify the notations 
by assuming that P{fu) = 0. If it is not the case, replace f^ by the physically 
equivalent potential f^ — P{ffj). Recapitulating, we obtain that there exists a 
constant K' > 0 such that for all x”, all uj G [x"], we have the uniform estimate 


< 


P([x^]) 


exp(E;=d/f|(0,^)) 


< K'. 


( 5 ) 


Of course, the same estimate holds for P^ with the obvious modihcations. This 
immediately gives that there exists some constant K > 0 such that 


n—1 

-K<Sn- Y.[if^ - /+h) o Oj] < K (6) 

1=0 

for all n > 1. Using m and the Ergodic Theorem, we deduce immediately that 

MEP = |(/+-/+JdP. 

The possibility of working with a “one-sided” potential physically equivalent 
to the “two-sided” one is very important because it will allow us to apply known 
results obtained by transfer-operator techniques. 
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The assumption 0 also implies a “strong mixing” property which is needed 
to prove our results. When dealing with central limit asymptotics, we will re¬ 
strict ourselves to potentials having exponentially decreasing modulus of conti¬ 
nuity, i.e., 

3(7 > 0,0 < T/ < 1 such that vainfu < C'rf' Vn > 1. (7) 

This will allow us to use a result proved in M- We will precise further these 
points at the appropriate places. 

Remark 1. If we assume that 

diam(A)var(C/(A, •)) < oo 

A:min A=0 

where var([/(A, •)) := max(17(A, •)) — min(f7(A, •)) this implies 0, see m- 


3 Estimators of entropy production based on hitting 
and return times 


In this section we introduce two estimators based on a single trajectory or 
on two independent trajectories. To define them we have to introduce hitting 
times. 

The hitting time of a cylinder [x"] is defined as 


■= inf{A: > 1 : G [xf]} . 

For the sake of convenience, we introduce the notations 


Tn(‘^) := and (w) := T^i (w). 

The hitting-time estimator S^{lv) of the entropy production is defined as 


S^iuj) := log 


Tfjco) 

T+(w) 


In words, this is the difference of the logarithms of the first time at which 
we observe the first n symbols in reversed order in the trajectory and the first 
return time of the first n symbols. It will follow from our analysis that typically, 
T“ S> if the process is not reversible. Hence our hitting-time estimator of 
the entropy production will be typically positive. 

The waiting-time estimator of the entropy production is based on 

two trajectories chosen independently of one another according to P. We 
introduce the following convenient notations: 


W+{u;,uj’):=T^n{u>) and W-(u;,a;0 := T,i (c^O • 

The waiting-time estimator is then defined as 

The main motivation to introduce this alternative estimator is that we will 
obtain a better control of its large deviation properties. 
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Remark 2. We can define two other estimators based on the so-called match¬ 
ing times m- They are in some sense the “duals” of the above estimators. To 
introduce the “dual” of the hitting-time estimator, consider the first n symbols 
xi,.. .Xn of the process and define 

= min{/i; < n : the word does not reappear in xf} 

and 

L“ = min{A: < n : the reversed word xj, does not reappear in xfi} 

Then the estimator of the entropy production dual to the hitting-time estimator 
is given by log(L^/Lt). 

The advantage of these estimators is that they are based on a trajectory 
of finite length n. However, all the asymptotic fluctuation properties of these 
estimators can be derived from the ones of the present paper by the duality 
relations. So we do not study them in detail in this paper. 


4 Convergence and fluctuations of the estimators 

We now state our results on consistency and asymptotic normality for the esti¬ 
mators we just introduced, as well as large deviation properties for estimators 
based on two independent trajectories. Recall that MEP is the mean entropy 
production, see 


4.1 Almost-sure approximation and consistency 

The following theorem provides an almost-sure approximation of S„, the en¬ 
tropy production up to time n (see ( 0 ), by both the return-time and the 
waiting-time estimators. 

Theorem 1. Assume that 0 holds. Then there exists a constant C = C (P) > 
0 such that 

1. Eventually W’-almost surely 

—C log n < Sfi — Sn < C log n ; 


2. Eventually ¥x¥-almost surely 

-Clogn <S^ -Sn< Clogn. 


Using the previous theorem and m, we immediately obtain the following 
corollary establishing the consistency of our entropy production estimators. 

Corollary 1. We have the following almost-sure convergences: 

1. ¥-almost surely 

lim ^ = MEP ; 

n^oo Ti 


2. ¥x¥-almost surely 


CW 

lim -TH = MEP . 

n^oo Ti 
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4.2 Asymptotic normality 

The expectation with respect to P is denoted by E. Let 

:= ^ [E((/+ - /+J • (/+ - /+«) o 9e) - (E(/+ - f+^)f] . (8) 

£>1 


It can be showed that cr^ < oo if 0 holds. It is well-known that cr^ > 0 unless 
U is physically equivalent to U^, i.e., is a co-boundary, which in turn 

is equivalent with P = P^, i.e., the process is reversible. For more details on 
this, we refer to [HI- 

Theorem 2. Assume that 0 holds. Then we have the following eentral limit 
asymptotics: 

1. For the hitting-time estimator 


5" - nMEP 

y/n 




as n 


oo 


in ¥-distribution. 


2. For the waiting-time estimator 


Sff - nMEP 

\/n 


AA(0,(t2) 


as n 


oo 


in ¥x¥-distribution. 


Moreover, 




n 


n 


where Var denotes the variance. 


(9) 


Remark 3. Using the results of m, we could extend the previous theorem to 
potentials with a modulus of continuity decreasing polynomially, i.e., like 1/n" 
for a > 0 large enough. 


4.3 Large deviations 

Our goal is to analyze the deviations of order one of Sff /n around the mean 
entropy production MEP. To this end, we introduce the following “free-energy¬ 
like” function, which is nothing but the scaled-cumulant generating function for 
the process (S^): 

y\^u(p) ■= lim — logEpxp fe^'^^) , p G M 

n—>oo n V / 

provided the limit exists. On another hand, define the scaled cumulant gener¬ 
ating function for the process (S„,) as: 

£u{p) ■= liiR — logEp f) ,pGM. 
n^oo n V / 
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It is easy to deduce from © that 


£u{p) = P{-pfuR + (1 +p)fu) , Vj? e M. 

From this formula one immediately sees that 

-p) = £ur{p) ■ 

On another hand, it is obvious from the definition of that 

£u{p) = £ur{p) ■ 


Hence 

Eu{-l-p) = £u{p) 

which is a version of the Gallavotti-Cohen fluctuation theorem, see M, m, 

uni- 

Notice that < 5(7 = 0 if 1/ is physically equivalent to U^. 

We now state a large deviation result for Sn- Let lu be the Legendre 
transform of Ejj: be-, 

Iu{q) = sup {pq - £u{p)) ■ 



Proposition 1. Assume that 0 holds and that the process (Xn) is not re¬ 
versible (i.e., that U is not physically equivalent to U^). Then the function 
p I—> £u{p) is continuously differentiable and strietly convex. Moreover, there 
exists an open interval {q,q) such that, for every interval J with J r]{q,q) 7 ^ 0 


lim — log P 

n^co fi 


S„(Xi, 




n 



= — inf 
qeJn{q,q) 


Pu{q) ■ 


The interest of this result lies in its formulation adapted to our context and 
convenient to state the next result, the main one of this section. In essence 
such kind of result appears, e.g., in m- 

Theorem 3. If assumption 0 holds then we have 


Wu{p) 


£u{p) if - 1 < p < 1 
+00 otherwise. 


( 10 ) 


In particular, if the process (Xn) is not reversible (i.e., U is not physically 
equivalent to U^) then and Sn have the same large deviations in the open 
interval (c_,c+), with c_ := limp_,_i < 0 and c+ := Wrup^i E'jjfp) > 0 .' 

For every interval J with J n (c_,c_|_) / 0 


1 f 1 

lim — logP < -TP G J > = — inf Puio) ■ 

n^oo n In J ijGjn(c_,c+) 


( 11 ) 



It is easy to check that MEP G (c_,c_|_). Indeed £'u{^) = MEP (one uses 
differentiability and convexity to prove that). 

The next proposition highlights the symmetry properties of W. We write 
explicitly the dependence of W on the potential U. 

Proposition 2. Under assumption © we have the following identities 
1. For all —1 < p < 0, we have 


Wu{-l-p) = Wu^{p) = m{p) = Wur{-1-p) ■ 


2. For all p G (—1,1), we have 

W[/(p) = Wun{p) . 

Remark 4. One may ask why we did not study the large deviations of , 
the hitting-time estimator. Indeed, the analysis of the corresponding scaled cu- 
mulant generating function is made more complicated due to the effect of “too 
soon” recurrent cylinders. We shall not detail more on this. Following the ap¬ 
proach of OF, we can obtain a partial counterpart of Theorem 0 for 5" ; its 
scaled cumulant generating function coincides with £u{p) but only in an implicit 
interval [c_,c+], where c_ < 0 and c+ > 0. 


5 Proofs 


5.1 Key lemmas 

The following results are the main tools to derive our results. 

Key-lemma 1. Assume that ¥ is a translation invariant Gibbs measure such 
that © holds. Then there exist strictly positive constants c, C, pi, P 2 , with pi < 
P 2 , such that for all n G N, all cylinders [a”] and all t > 0 there exists p{af) G 
[pi,P 2 ] such that 


P{Ta-P(K]) >t}- 




( 12 ) 


Proof. In pp, the author proved this result under the assumption that the 
process is ■0-mixing. Besides, it is proved in m that if f^ has summable vari¬ 
ations, then the process {X^) is ^’-mixing. (This can be read off the proof of 
Theorem 3.2 in HO].) □ 


The next lemma will be crucial to control certain moments. This is a rewrit¬ 
ing of Lemma 9 in pQ . 

Lemma 1. For all cylinder [af], all t such that t < 1/2, we have 
1 - < P{TanP(K]) < t} < 1 - 

where pi,p 2 are the constants of Key-lemma^ 
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We now state the analog to Key-lemma ^ for return times. To do so, we 
need to define the set of n-cylinders with “internal periodicity” k < n: 


•Skin) := {[oi] : min{j G {1, : [oi] n Ojla^] / 0} = /c} . 


Notice that the set of n-cylinders can be written as Ui<p<n 

Key-lemma 2. Assume that ¥ is a translation invariant Gibbs measure sueh 
that (|1]) holds. Then there exist strictly positive eonstants c,c',C sueh that for 
any n G N, any k G {1, any eylinder [a^] G Skin), one has for all t > k 


P{cu : T,.(a;)P(K]) > t\ K]} - C(a?) exp(-C(a?)t) 


< C 


e 


-c't 


(13) 


where C(“i) is sueh that \ C(oi) “ p(Qi)I < S)e for some D > 0. The 
parameter piaf) is defined in Key-lemma^ Moreover, 

P{a; : Ta?^(a;) > t \ [fli]} = 1 for all t < k. 

Proof. This Key-lemma is a rewriting of [21 Section 6]. As for the previous 
Key-lemma, the assumption is that the process is "^-mixing. □ 


5.2 Proof of Theorem [T] 

Let us start with the proof of the second statement of the theorem. We shall 
prove that eventually PxP-almost surely 

—Cl log n < log(W^(a;,a;')P([a;”]) < logCi -|-log log n (14) 

for some Ci > 0. It will be clear that by the same reasoning we will also have 
that eventually PxP-almost surely 

-C 2 logn < log(W“(w,w')P([ti;n]) < logC 2 -Floglogn (15) 

for some C 2 > 0. Putting together these two results immediately gives the 
statement 2 of the theorem. 

We first prove the upper bound in (d. We want to find a summable 
upper-bound to 

PxP{log(W+P([xi])) > logt} = 

j;P([x^]) P{log(T,.P([x?])) > logt} (16) 

where t will be a suitable function of n. We apply Key-lemma ^ to get for all 
t > 0 

PxP{log(W+P([x^])) > logt} < Ce-^^ + . 

Take t = tn = log n"^, ai > 0, to get 

PxP{log(W+P([x?])) > loglogn“} < Ce-'^" + . 
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By the Borel-Cantelli Lemma we get 

log(W+P([a”])) < loglogn“i 

eventually PxP-almost surely provided that aipi > 1. 

To obtain the lower bound in d, we have, by Key-lemma ^ 

PxP{log(W+P([x7])) < logt} < + 1 - < q^-cu ^ 

for all t > 0. Choose t = tn = 0:2 > 1 and apply the Borel-Cantelli 

Lemma to get 

log(W+P([x"])) > -Q! 2 logn 
eventually PxP-almost surely. 

Let us now prove the first statement of the theorem. The proof is very 
similar except we have to deal with “bad” cylinders and use Key-lemma |2j We 
will only establish that eventually P-almost surely the inequality 

-Cl log n < log(T+(a;)P([cui]) < logCi -Flog log n (17) 

for some Ci > 0. The analogous inequality for T“(a;) is obtained as above (i.e., 
using Key-lemma^). We have the decomposition 

P{a; : log(T+(u;)P(K])) > logt} = 

n 

Y, Y ^([^ 1 ]) ^ log(T, 5 .(a;)P([x 7 ]) > logt | K]} 

k=l x'^^Sk ( 71 ) 

where Sk{n) is defined just before we state Key-lemma |2j For all t > A:P([xi]) 
and n large enough, we get using Key-lemma |21 

P{log(T,,nP(K]) > logt I K])} < (P 2 + D)e-^^ + Ce-^^ 

where we used the fact that if n is large enough, pi/2 < pi — De~^'^ < C(“i) < 
P 2 + D. We now choose t = tn = logn“L ai >0. If n is large enough, then 
tn > /cP([a”]). This is because we have the uniform estimate P([a”]) < 
for some G > 0, since P is a Gibbs measure. Hence we obtain 

P{log(TjP(K])) > loglogn”'} < +Ce-“ 

which is summable provided that aipi/2 > 1 . The Borel-Cantelli Lemma then 
gives the upper-bound in m- The lower-bound is obtained as for the waiting¬ 
time estimator but using Key-lemma |21 □ 

5.3 Proof of Theorem [ 2 I 

Let us prove the second statement of the theorem and that lim„ 
cr^. For this it is enough to prove that 

- S„)^dPxP = 0. 



Var(4^) ^ 

n 

( 18 ) 
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Indeed, proving m implies, on one hand, that 


lim MM = lim MI'S. 


W) 
n ) 


n—>-oo Tl 


n^oo Tl 


On the other hand, it also implies that (S^ — nMEP )/^/n converges in law to 
the normal Af(0, a^) if, and only if, (S„ — nMEP)/\/n converges in law to the 
same law. 

Now it is obvious from m that 

s„ - Kfu - /JMhl ^ 0 P - almost-surely. 


n 


By applying a result of m we obtain that 

E";o‘i(/ci - /J«)» Dj] - »mep 


in law 


n 


AA(0,ct2). 


Since we have the formula (see EH) 


n—1 




1 n ^ 

it is obvious by that 


i=o 


lim MM = ,2 

n^oo Tl 

Therefore we have reduced the statements of the theorem about to 
proving m- By definition we have 

/ (5^-S,,)'dPxP = ^P(K]) f [log(T-p([xi]))-log(T+P([x’(]))]'dP. 

Let us now prove that the integral in the rhs is bounded above by a positive 
number independent of n, implying immediately m- To prove this assertion, 
it is sufficient to prove that 

I [log(T+P(K]))]'dP<Z)i, I [log(T-p([xi]))]'dP<I )2 (19) 

where L^i, D 2 > 0 are independent of n. We only prove the first inequality since 
the other one is proved in exactly the same way. 

We have the following identities: 

/ roo 

[log(T+P(K]))] "dF = P ([log(T+P(K]))]2 >t)dt = 

2 r P (T+P(K]) > t) dt + 2 P (T+P([x^]) < t) dt = 


l^“p(T,nP([x-]) > t) ^ dt + 2^'p(T^nP([x-]) < t) 


-logt 


dt=:l + ll. 
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Now we use Key-lemma Q and get 


P (T^nP([x^]) > t) < (1 + C)e-P^\ Vn > 1. 


Therefore 


I < 


2(1+ C)^ 


°°logt 


t 


dt =: D[ < 


oo. 


For the integral II, we have the following estimates 


II = 2 


+ < t) dt < 


-logt 


(1 - e-P^^) dt + 


- logt 


dt < 


L 


-p 2 / logt dt - 


1^ 

T t 


dt := D'I < oo 


where we used Lemma ^ to bound the first integral. 

This finishes the proof for the waiting-time estimator. Concerning the 
hitting-time estimator, we leave the proof to the reader. It is very similar 
to the previous one except that one has to use Key-lemma HJ □ 


5.4 Proof of Proposition [U 

The proof is an application of Gartner-Ellis theorem [^. In particular we have 
to check that the function £u (p) is continuously differentiable and strictly 

convex under assumption dlj . The strict convexity follows from the assumption 
that the process is not reversible. As already mentioned above, this amounts to 
requiring that U is not physically equivalent to C/^, i.e., that is not a 

co-boundary. The open interval {q,q) is defined by g = inf^^R = limp^_oo S'uip) 
and q = sup^^R = limp^+oo <?[/(p). These limits exist by convexity arguments. 
We refer to |H] from which one can deduce these classical facts on differentiability 
and convexity of the pressure function. □ 


5.5 Proof of Theorem!^ 

We prove formula m- We first deal with 0 < p < 1. The case —1 < p < 0 is 
obtained by a similar reasoning, so we omit the proof. The case p = 0 is trivial. 
We observe that 


- 


^P([x^]r¥([xi])-?’ Ep 


where Yn := T 3 ,iP([x^]), Zn '■= Ta,™E([x”]). We then have 


Y \P' 

^ n 

Zn 


poo pc 

/ 

Jo Jo 


dz 


W 


P{K„ G dy, Zn G dz} 
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1 1 (* OO /* oo 

= / dy dz (^-Y P{yn G dy,Zn G dz}+ dy dz (^y ^{Yn G dy,Zn G dz} 

( 20 ) 

We obtain the obvious upper bound 


roo POO 

((201) < dy dz — PIW G dy, Zn G dz} + / dy dz y^ P{yn G dy, Zn G dz] 

Jo Jo Ji Ji 


- iEp(^^j+Ep(yp). 

We get easily the lower bound 

POO POO 

((201) > / dy dz — Pjy^ e dy, Zn G dz} 

Ji Ji 


( 21 ) 


> Ep (^^I{Zn > 1} 


( 22 ) 


where /{•} denotes the indicator function. 

Proving Theorem O for 0 < p < 1 is thus reduced to proving that the rhs in 
m is bounded above by a positive number independent of n, and that the rhs 
in (El is bounded below by a positive number independent of n. 

Let us start with an upper bound for Ep(y^). We have 

POO 

Ep(yP) = p / yP-ip{T,iP([xi]) >y}dy. 

Jo 

By using Key-lemma ^ with a” = x\, we obviously have P{T 3 ,iP([x)j]) > y} < 
Ae~^y for some A,B>Q. 

Let us now upper-bound Ep • We have 

(i) = (i' + /r) ^■''’'■MT.yP(K]) <z}dz. 

The integral from ^ to oo is bounded above by z~^^^~^dz < oo. To bound 
the other integral we use Lemma ^ 

lY 2 -l^’l-ip{T,nP([x-]) <z}dz< lY ^ ~J^YY dz < oo. 

We now estimate from below Ep(yf/{yi > 1}). We have 

/ OO 

y-W-ip{T,iP([xi])<y}dy. 

By Key-lemma^ with o" = x” we have 

P{T,iP([xi]) < y} > 1 - (1 + Ce—. 
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Observe that 1 — (1 + Ce '^"')e > 1 — (1 + Ce ™)e for all y > 1 and for 

all n > 1. Therefore 


Ep{YPl{Yn > 1 }) > 1 - (1 + > 0 


provided that n is large enough. 

Recapitulating, we proved that for all 0 < p < 1 and all n large enough 


i? ^ < Ep 


Y„ 


< E 


for some E > 0 independent of n and x”. Hence, for all 0 < p < 1, we get 
lim - logEpxP = lim - log P([xi])p+^E([x^])~p = £u{p). 

n^oo Tl V / n^oo ft 


The last equality follows obviously from © and Q. 


We now turn to the case \p\ >1. We only deal with the case p > 1 since 
the case p < — 1 is obtained by the same reasoning. We have 


Ep 



> p P{T,nP([x-]) < y} dy 

Jo 

> p[ ^(l-(l + Ce-^>-"^")dy 

Jo 

= +00 


(23) 

(24) 

(25) 


for n large enough and where we used Key-lemmanto get the second inequality. 

To prove m, we apply a variant of Gartner-Ellis theorem found in m 
To this end, we use formula m and the differentiability/convexity properties 
of the function p £u{p). We have to restrict to the interval (c_,c+) where 
Wu is finite and coincides with £u. □ 
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